AD  A 0 4 0 5 4 7 


The  University  of  Texas 
Austin,' Texas  78712 


Research  Report  CCS  285 


AN  APPLICATION  OF  QUASI-INTEGER 
PROGRAMMING  TO  A CAPITAL  BUDGETING 
PROBLEM  IN  PAVEMENT  MAINTENANCE 


R.  D.  Armstrong 
W.  D.  Cook* 

F.  E.  Palacios -Gomez 


March  1977 


n o c 

■ ■ 

1 * - 


li  JUH  1 4 

c 


-'Faculty  of  Administrative  Studies,  York  University,  Toronto,  Ontario. 


This  research  was  partly  supported  by  Project  NR047-O21,  ONR  Contract 
N00014-75-C-0569  *with  the  Center  for  Cybernetic  Studies,  The  University 
of  Texas.  Reproduction  in  whole  or  in  part  is  permitted  for  any  purpose 
of  the  United  States  Government. 


CENTER  FOR  CYBERNETIC  STUDIES 


A.  Charnea,  Director 
Business -Economics  Building,  203E 
The  University  of  Texas 
Austin,  Texas  78712 
(512)  471-1821 


\ Ap’ 


ABSTRACT 


» This  paper  models  a capital  budgeting  problem  in  pavement  maintenance 

as  a nonlinear  quasi-integer  knapsack  program  and  presents  a solution  pro- 
cedure. It  must  be  determined  if  certain  segments  of  road  will  be  repaved 
or  major  maintenance  postponed  for  at  least  another  year.  If  the  road  is 
to  be  repaved,  a certain  amount  of  variation  in  the  funds  expended  is 
possible.  The  marginal  return  within  the  allowable  interval  of  variation 
is  estimated  to  be  nonlinear.  Also,  a single  linear  constraint  limiting 
^ the  total  amount  of  funds  expended  is  present.  Computational  experience 

with  the  algorithm  and  a brief  overview  of  other  applications  of  the  model 

are  given. 

I 
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1.  Introduction 


Capital  budgeting  problems  in  the  operations  research  literature  are 
frequently  formulated  as  zero-one  linear  programming  problems.  However, 
it  may  occur  that  the  "go  or  no  go"  restrictions  characterized  by  binary 
constraints  are  too  abrupt.  Projects  are  often  either  not  funded  or  funded 
within  some  interval.  Modifications  to  a branch-and-bound  algorithm  to 
handle  these  "quasi-integer"  constraints  when  returns  are  linear  within 
the  interval  are  given  by  Armstrong  and  Sinha  [1].  In  this  paper  we  will 
consider  a quasi-integer  problem  with  nonlinear  returns  and  a single  linear 
budget  constraint.  This  is  a generalization  of  the  classical  binary  knapsack 
problem. 

The  next  section  of  this  paper  presents  a detailed  discussion  of  a 
quasi-integer  nonlinear  knapsack  problem  that  the  authors  have  encountered. 

Our  particular  application  deals  with  the  allocation  of  funds  for  pavement 
maintenance  projects  in  the  province  of  Ontario.  A segment  of  road  will 
either  be  completely  repaved  or  major  maintenance  will  be  postponed  for  at 
least  another  year.  If  the  road  is  to  be  repaved,  a certain  amount  of 
variation  in  the  funds  expended  is  possible.  Of  course,  when  more  funds 
are  expended  a higher  quality  road  is  constructed  and  a slower  rate  of 
deterioration  takes  place.  The  marginal  value  of  expenditures  beyond  a 
base  level  is  estimated  to  be  nonlinear  and  a nonlinear  quasi-integer 
knapsack  problem  arises.  While  we  will  be  mainly  interested  in  this 
application  to  pavement  maintenance,  it  is  apparent  that  other  capital 
budgeting  problems  may  be  modeled  in  a similar  manner. 

Section  3 of  this  paper  presents  the  theoretical  foundation  for  the 
algorithm  along  with  the  general  branch  and  bound  concepts  utilized.  Section 
4 discusses  an  implementation  of  the  algorithm  which  parallels  what  we  believe 
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to  be  the  most  efficient  methods  for  solving  the  binary  knapsack  problem. 
Computational  experience  with  a computer  code  version  of  the  algorithm  is 
given.  Section  5 presents  a sample  pavement  maintenance  problem. 


i 


2.  Applications 

The  quasi-integer  knapsack  model  finds  application  in  numerous  areas 
involving  capital  budgeting  on  a single  period  basis.  The  pavement  mainte- 
nance problem  which  gave  rise  to  our  research  in  this  areas  will  be  discussed 
in  some  detail  but  other  applications  are  apparent. 

In  both  USA  and  Canada,  highway  authorities  are  responsible  for  initiating 
effective  maintenance  strategies  on  pavements  when  required.  Pavement  mainte- 
nance is  an  area  where  millions  of  dollars  are  allotted  annually  for  correction 
of  defects.  One  particular  highway  management  system  with  which  the  authors 
are  familiar  is  the  Ontario  Ministry  of  Transportation  and  Communications. 

This  organization  maintains  a vast  bank  of  inventory  (data)  on  the  condition 
of  all  pavements  in  the  province.  The  pavement  condition  rating  (PCR)  relates 
to  the  structural  adequacy  as  well  as  to  the  geometries.  Structural  adequacy 
is  a function  of  the  extent  of  cracking,  roughness,  frost  heaving,  settling, 
flushing  and  numerous  other  distortions.  Geometries  have  to  do  with  the  adequacy 
of  lane  width,  slope  and  crossfall  standards,  shoulder  width,  ...,  etc. 

Studies  conducted  during  the  past  fifteen  years  in  the  USA,  Australia, 

Kenya,  and  Brazil  (see  for  example  [3],  [12]  and  [13])  have  provided  information 
sources  which  are  the  principal  inputs  to  decisions  relating  to  highway  reha- 
bilitation. Data  is  available  on  pavement  performance  overtime,  (relative  to 
a variety  of  indices),  under  various  rehabilitative  alternatives.  The  alterna- 
tives available  can,  for  purposes  of  illustration  be  classified  as  1,  2 or  3 
lifts  of  hot  mix  asphalt,  reconstruction,  recycling  and  hot  mix  patching. 

A 
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By  using  data  from  the  available  studies  as  well  as  from  historical  records, 
pavement  performance  curves  like  the  one  illustrated  in  figure  1 have  been 
obtained. 

A family  of  functional  forms  which  fit  the  data  best  and  which  were 
used  in  the  analysis  is  the  set  of  all  exponentials  of  the  form 


P - P = KA6 

o 


Pq  is  the  rating  immediately  after,  say,  a 2 lift  resurfacing,  P is  the 
rating  A years  after  the  resurfacing,  and  K and  j are  regression  coefficients. 
This  family  of  curves  was  used  in  analyzing  pavement  performance  in  the  AASHO 
road  tests  [13]. 

In  most  instances  once  the  highway  has  been  placed  into  a given 
category  according  to  traffic,  number  of  lanes  and  region,  the  design  (that 
is,  the  particular  alternative  of  the  ones  listed  above)  is  fixed.  The  aspect 
of  rehabilitation  which  isn't  predetermined,  however,  and  about  which  we  are 
concerned  in  this  article,  has  to  do  with  variation  within  a design.  That 
is,  once  a design  has  been  decided  upon,  up  to  10  or  15%  over  the  minimum 
cost  necessary  to  meet  standards  can  be  spent  on  improving  the  future  per- 
formance of  a highway. 

Different  coefficients  K and  6 can  be  generated  from  data  on  different 
levels  of  rehabilitation  within  the  selected  standard.  Many  different 
criteria  exist  for  evaluating  pavement  performance.  User  cost,  roughness, 
average  PCR  (per  year),  total  PCR  over  the  life  of  the  pavement  are  examples. 
For  purposes  here  we  take  the  area  under  the  PCR  curve  as  a measure  of  worth 
of  a pavement  for  a fixed  analysis  period  of  T years  (e.g.,  T = 10)  with 
some  allowance  for  salvage  to  be  made  after  that  time. 
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For  different  levels  of  expenditure  x,  on  project  j different  per- 

vJ 

formance  curves  arise;  that  is,  for  each  x . , appropriate  K and  6 values 

J 

can  be  determined.  We  assume  xi  can  lie  in  the  range  [1,  u.l  (x.  has  been 
scaled  by  the  minimum  positive  allocation).  The  worth  of  the  pavement  is 
then  given  by 

(2.1)  fj(xj)  - P (Xj)  + K(Xj)  Ae(xj}]  dP  + Sj(xj) 

where  Sj(xj)  is  the  salvage  value. 

There  are  many  different  ways  of  measuring  the  salvage  value  of  a road. 

Generally,  S ^ ( x - ) should  represent  the  long  run  worth  of  the  road  following 

the  analysis  period  which  ends  at  time  T.  Perhaps  the  most  realistic 

approach  in  measuring  S^x.)  is  to  assume  that  an  optimal  maintenance 

procedure  will  be  used  after  T.  Then  using  standard  discounting  methods 

over  a 20  or  30  year  period  following  T,  take  S.(x.j)  to  be  the  best  value 

which  can  be  attained  subject  to  budget  restrictions.  Salvage  tables  are 

currently  available  for  roads  in  the  various  categories. 

Let  n denote  the  number  of  potential  projects  to  be  programmed.  If 

xi  = 0 project  j is  not  programmed;  otherwise,  1 < X;  £u..  We  therefore, 

J J j 

wish  to  solve  the  quasi-integer  programming  problem 

n 

Maximize  l Mx-), 
j=l  J J 

n 

I a ,x . < B 
j-i 

1 <.  x.  ii.  or  x.  = o,  j = 1.  2, 

J J J 


• • • » 


n, 


r 

»■ 
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where  B is  the  total  budget  and  a.  is  the  minimum  nonzero  expenditure 

J 

on  project  j. 

The  functions  f.(x-)  take  a form  similar  to  that  shown  in  figure  2. 

• J J 

A quadratic  provides  an  appropriate  fit  to  the  points  generated  from  (2.1), 
so  that  the  form  of  f ( Xj ) assumed  in  (2.2)  is 

(2.3)  f ( Xj ) - bjX/  ♦ cjXj  * 

and  f(x.)  = 0 for  x.  t [1,  u.]. 

J J J 

I In  a later  section  we  provide  an  example  illustrating  the  use  of  these 

functions. 

In  the  above  we  have  described  an  application  of  the  quasi-integer 
knapsack  model  for  allocating  funds  towards  pavement  maintenance.  Another 
example  arises  in  defense  construction.  When  funds  are  allocated  to  mainte- 
nance projects  on  a military  base  it  is  in  many  cases  true  that  a variable 
amount  of  funds  in  some  range  can  be  allocated  to  a project.  Different 
levels  of  improvements  in  the  existing  condition  of  electrical  facilities 
can  be  made.  Repairs  to  hangars  and  the  associated  facilities  for  aircraft 

i 

maintenance  can  be  initiated  at  different  levels.  So,  the  amount  of  money 

x.  allotted  to  project  j is  either  0,  if  no  maintenance  is  carried  out,  or 

• J 

Xj  lies  in  a closed  interval.  A measure  of  performance  might  be  taken  as 
the  replacement  value  of  the  project. 

In  the  following  sections  we  present  an  algorithm  for  solving  (2.2). 

3.  Algorithm  for  a Nonlinear  Quasi-Integer  Knapsack  Problem 

r:  We  will  attempt  to  make  the  description  of  the  algorithm  as  general 

• 

as  possible  while  taking  full  advantage  of  the  structure  associated  with 
the  pavement  maintenance  application.  It  is  assumed  that: 

ku  i m _ ....  .. 
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(i)  Mxi)  in  the  closed  interval  [1,  uJ  and  f.(x-)  = 0 
elsewhere.  That  is,  for  simplicity,  the  intercept  term  of 
(2.3)  has  been  scaled  appropriately  so  that  the  origin  re- 
flects the  value  of  fj(0). 

(ii)  f - ( x • ) is  a monotone  increasing  concave  function  for  x-  e [1,  u-]. 

J J J J 

(iii)  fj(xj)  is  differentiable  for  Xj  e [1,  u j ] , where  the  derivative 
fj(xj)  is  defined  to  be  the  right  derivative  at  1 and  the  left 
derivative  at  Uj. 

(iv)  The  inverse  function  of  fj(xj),  1 <_  x j £ u j , is  obtainable  in 

closed  form.  That  is,  if  r.(x.j)  is  the  inverse  function  of 

J J 

f j ( x j ) * then  yj  = fj(xj)  irT,plies  that  rj (y j ) = xj* 

Extensions  of  the  algorithm  to  handle  relaxations  of  assumptions  (iii)  and 
(iv)  will  be  discussed  in  the  conclusions.  Notice  that  although  we  use  the 
term  "quasi-integer",  no  restriction  is  placed  on  the  value  of  Uj  other  than 
it  be  greater  than  one.  However,  in  our  application,  Uj  will  generally  be 
between  1.05  and  1. 15. 

A branch-and-bound  procedure  [5,7]  will  be  developed  to  solve  problem 
(2.2).  A convex  relaxation  of  the  problem  will  be  solved  at  each  node  and 
the  dichotomy  performed  will  restrict  some  x.  to  be  0 down  one  branch  and 

J 

to  be  in  [1,  uj]  down  the  other  branch.  The  branching  process  continues 
to  split  the  solution  space  into  smaller  and  smaller  subsets  until  the 
optimal  solution  to  the  original  problem  is  identified. 

The  relaxation  is  achieved  by  looking  at  each  project  on  an  individual 
basis  and  determining  the  largest  return  per  dollar  invested.  This  is  given 
by 


f J ( Xj ) /aj xj  = maximum  fj(xj)/ajxj*  J = 2, 


n. 
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To  show  that  x.  can  always  be  obtained  through  standard  calculus  procedures 

J 

whenever  our  assumptions  are  satisfied,  we  prove  the  following  theorem. 

Theorem  1.  The  function  e(x)  = f(x)/ax  is  quasi-concave  in  the 
interval  [1,  u]  when  f(x)  is  concave  in  this  interval  and  a > 0. 

Proof.  Let 

fia  = {X  |x  e [1,  U],  e(x)  >_  a} 
or 

fta  = {x  |x  e [1,  u],  f (x)  >_  aaxl 

If  X E !2a  and  y then  f(y)  >.  oay  and  f(x)  j>  aax.  By  the  concavity  of 
f(x) 

f(  x + (1  - A)y)  >_  Af ( X ) + (1  - A)  f (y ) >_  aax  + (1  -A)aay 
= aa(  Ax  + ( 1 - A)y)  = aaz,  for  0 £ A <_  1. 

Hence,  z = Ax  + ( 1 - A)y  is  in  Ua  and  na  is  convex.  By  theorem  9.1.3  from 
Mangasarian  [9]  we  have  that  0 (x)  is  quasi-concave. 

Q.E.D. 

★ 

Therefore,  the  point  Xj  is  equal  to  either  the  left  end  point  of  the 
interval  or  can  be  obtained  by  taking  the  first  derivative  of  ejx-).  setting 
it  equal  to  zero  and  solving.  Assuming  the  latter  situation  holds,  we  have 

VXj)/a3Xj  - f0(XJ)/aJXj  2 = 0 


or 


VV = Vxj>/xj 


Figure  3 presents  two  possible  f.(x.)  and  the  corresponding  x.. 

J J J 

It  will  be  assumed  hereafter  that  the  projects  are  ordered  so  that: 
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(3.1) 


★ . ★ * ★ 
f1(x1)/a1x1  > f2(x2)/a2x2  >_ 


> fn(x*)/a  x* 
- nv  n'  n n 


The  same  procedure  is  employed  in  the  solution  of  the  binary  knapsack  pro- 
blem where  projects  are  ordered  in  terms  of  best  bang-for-buck. 

We  define  h - ( x - ) to  be  the  line  passing  through  the  origin  and  the 

J J 

•fe  ir  • ^ 

point  (x.,  f.(x.)).  Notice  that  h-(xj)  is  a line  tangent  to  f.(x-)  at  x. 

J J J JJ  J J J 

★ 


whenever  xn-  is  a relative  interior  point  of  [1,  u.]. 

J J 

By  letting 


1/  \ * 

MXj),  Xj  < Xj 

fjlXj),  Xj  i x* 


we  can  write  the  following  con vexifi cation  of  (2.2). 


(3.2) 

subject  to 


Maxi  mi ze 


n 

£ 9n (x  ) , 
j=l  J J 


a-x.  < B 
J J - 


0 < x.  < u. 
- J - J 


Problem  (3.2)  is  clearly  a relaxation  of  (2.2).  Hence,  che  optimal 
objective  value  for  (3.1)  provides  an  upper  bound  on  the  optimal  objective 
value  for  (2.2).  If  an  optimal  solution  to  (3.2)  is  feasible  for  (2.2), 
then  it  is  optimal  for  (2.2)  as  well.  A similar  relaxation  is  used  by 
Miercort  and  Soland  [10]  for  solving  a discrete  nonlinear  problem  via 


branch  and  bound. 
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To  solve  (3.2)  we  consider  the  Langrangian  and  perform  a one  dimensional 
search  over  the  multiplier  until  the  optimal  solution  (within  a tolerance) 
is  obtained.  The  following  theorem  which  is  analogous  to  a result  for  the 
binary  knapsack  problem  gives  a constructive  procedure  for  determining  an 
interval  within  which  the  optimal  multiplier  must  be  contained. 

Theorem  2.  An  optimal  solution  to  (3.2)  exists  which  will  have  at 
most  one  component  of  the  solution  violating  the  constraints 


Xj  = 0 or  1 <_  Xj  i u j , j = 1 , 2 , . . . , n . 


Proof.  Let  A be  the  optimal  multiplier  for  the  Langrangean  problem: 

n n 

Minimize  Maximize  i g.(x-)  + A (B  - I a.x.), 

A x j=l  J J j=l  J J 

subject  to 


0 i x . < Uj , j ■ 1 , 2 , . . . , n 
and  A _>  0. 

From  the  Kuhn-Tucker  conditions  [9]  the  optimal  solution  x must  satisfy 


Uj  if  gj(uj)/aj  »i 

r^aji)  if  gjfujl/aj  < ^ < f(x*)/ajx* 

★ - ★ ★ 

a value  in  [0,  Xj]  if  A = f(xj)/ajXj 

0 if  A > f(x*)/ajXj 
n 

I a -x  = B if  A > 0, 

j-i  1 i 


and 


where  r^-)  is  the  inverse  function  of  the  first  derivative  of  f-(xH). 

J J J 

For  the  trivial  case  where  X = 0,  x,  = u, , j = 1,  2,  ....  n and  the  quasi- 

J J 

integer  constraints  are  satisfied.  Also,  the  quasi-integer  constraint  for 
variable  j is  always  satisfied  if  A f f(x*)/a,x*.  Hence,  the  theorem  will 

J J J 

_ ★ ★ 

automatically  hold  unless  A = f(xn-)/a-x.  for  more  than  one  j.  In  this  case, 
we  simply  invest  as  much  as  possible  in  a project  at  a rate  of  return  X 
before  investing  in  another  project  at  this  same  rate. 

Q.E.D. 

Let  x be  the  unique  component  of  x (the  optimal  solution  to  the 

relaxation)  which  violates  the  quasi-integer  constraint;  that  is, 

_ ★ 

0 < xr  < 1.  Then  x.  < < u.,  j < r and  x.  = 0,  j > r. 

J J J J 

The  branch-and-bound  algorithm  will  create  two  new  subproblems  by 
dichotomizing  as  illustrated  in  figure  4.  Therefore,  at  any  stage  of  our 
algorithm  we  are  solving  a problem  of  the  following  form  at  node  p. 


(3.4) 


Maximize 


I MM  + £ 9 ,-  ( x . ) 

j e JU  J J j e RL  J J 


subject  to 


I a,x.+  £ a.x.^B 

j e JU  J J j e RL  J J 


1 < x.  < u.,  j e JU 

J J 

0 < x.  < u.,  j e RL 

J J 


where  JU  gives  the  index  set  of  variables  which  are  restricted  by  the 
branching  process  to  be  in  [1,  uj]  and  RL  gives  the  index  set  of  variables 
which  have  not  been  restricted  as  yet.  There  is  a third  index  set  JZ  which 
gives  the  indices  of  the  variables  set  to  zero  by  the  restrictions  above. 
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The  initial  relaxation  (3.2)  has  RL  = (1,  2,  n) , JU  = <t>  and  JZ 

= <(>,  unless  dominations  within  the  solution  set  can  be  recognized.  This 
subject  will  be  discussed  in  the  next  section. 

It  is  apparent  that  the  result  of  theorem  2 can  be  extended  to  hold 
at  any  node.  Again,  an  explicit  representation  of  the  optimal  solution  to 
(3.4)  can  be  obtained  in  terms  of  the  optimal  multiplier.  For  completeness 
and  because  it  will  be  useful  later,  we  give  Kunh-Tucker  conditions  which 
the  optimal  solution  xp  at  node  p must  satisfy  in  terms  of  the  optimal 
mul tipi ier  xp. 

The  value  determined  by  (3.3)  for  all  j e RL 
Uji  j e JU,  XP  < fj(Uj)/Sj 
rj(ajXp) S j £ JU,  f j ( 1) /a j > xp  > fj(uj)/«j 
Is  j e JU,  x”p  > fjdJ/aj 
0;  j e JZ 

The  fundamental  steps  of  the  algorithm  have  now  been  specified.  The 
relaxation  at  each  node  is  given  by  (3.4)  and  because  of  Its  convexity  the 
above  gives  necessary  and  sufficient  conditions  to  identify  the  optimal 
solution.  Knowing  that  an  optimal  solution  to  (3.4)  which  is  feasible  for 
(2.2)  provides  a lower  bound  for  (2.2)  and  that  an  optimal  solution  at  any 
node  provides  an  upper  bound  for  all  its  descendants , a standard  branch-and- 


bound  algorithm  such  as  that  given  by  Geoffrion  and  Mars  ten  [7]  can  be  em- 
ployed to  solve  (2.2).  The  next  section  describes  how  we  have  implemented 
the  algorithm  in  a computer  code. 


(3.5)  xP  = 
J 
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4.  Implementation  and  Computational  Results 

When  implementing  our  algorithm  we  have  tried  to  incorporate  as  many 
of  the  techniques  used  in  solving  binary  knapsack  problems  as  possible.  As 
the  result  of  improved  pegging  techniques  and  clever  computer  coding,  very 
efficient  codes  have  been  written  to  solve  the  binary  knapsack  problem 
[2,  11,  15].  While  many  of  the  pegging  procedures  do  not  carry  over  to  our 
problem,  almost  all  of  the  list  structures  used  to  store  the  solution  tree 
information  are  applicable  with  appropriate  modifications.  We  begin  by  de- 
scribing how  we  develop  the  solution  tree  and  construct  the  relaxed  candidate 
problems  to  be  solved. 

Both  Barr  and  Ross  [2 ] , and  Zoltners  1 15 3 report  computational  im- 
provements in  binary  knapsack  algorithms  by  utilizing  a doubly-linked 
circular  list.  This  greatly  facilitates  constructing  and  resolving  relaxed 
candidate  problems  when  a last-in-first-out  (LIFO)  branching  rule  is  used. 

With  regard  to  the  nonlinear  quasi-integer  knapsack,  rather  than  use  an  array 
with  indicators  to  keep  track  of  the  index  sets  (for  example,  elements  of 
the  array  may  take  of  values  0,  1 or  2 to  indicate  that  the  corresponding 
variable  is  fixed  at  zero,  fixed  in  the  interval  ll,  u.]  or  free),  a doubly- 

J 

linked  list  and  a singly-linked  list  [81  are  used.  The  doubly-linked  list 
is  used  to  identify  the  free  variables  and  is  defined  as  follows  for  all  j e RL. 


s(j)  = 


minimum  of  S j , where  Sj  = (k:  k e RL , k > j 1 
minimum  of  RL,  if  Sj  = 0 

maximum  of  Pj,  where  Pj  = Ik:  k c RL,  k < jl 
maximum  of  RL , if  P - = 0. 

*J 


P(j)  = 
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A doubly-linked  list  is  used  because  it  is  very  important  to  maintain  the 
ordering  of  variables  as  prescribed  by  (3.1).  This  ordering  is  not  important 
with  the  variables  associated  with  the  JU  index  set.  Thus,  the  index  set 
JU  may  be  represented  as  singly-linked  list  as  follows  for  all  j e JU. 


s(j)  = 


(index  inserted  in  JU  immediately  prior  to  j's  insertion  in  JU 
0 if  JU  = 0 at  the  time  of  j's  insertion. 


When  an  index  (say  j)  is  to  be  removed  from  RL  and  placed  in  JU,  the 

lists  are  updated  as  follows:  k = p(j),  i = s(j),  p(i)  = k,  s(k)  = i s(j)  = 

m and  m = j,  where  m is  the  last  index  to  be  inserted  in  JU  and  is  initialized 

to  zero.  If  j is  later  removed  from  JU,  then  m = s(j).  Because  the  predecessor 

of  a variable  which  is  removed  from  the  RL  list  is  not  destroyed,  it  can  be 

inserted  back  in  the  RL  list  quite  easily.  If  j is  to  be  inserted  back  in 

RL;  k = p(j),  i = s(k),  s(k)  = j,  s(j)  = i,  and  p(i)  = j. 

Through  the  use  of  these  lists  accessing  of  information  in  the  desired 

order  is  expedited.  A variable  is  considered  when  determining  the  values  from 

(3.5)  only  when  that  variable  is  nonzero. 

The  algorithm,  as  coded,  further  restricts  the  unique  variable  Xj  with 

a value  in  the  interval  (0,  Xj),  first  inspects  the  candidate  problem  with 

1 £ xj  i uj  ar,d  uses  a LIFO  procedure  for  choosing  the  candidate  problem  to 

consider  when  backtracking.  The  step-by-step  method  for  solving  (3.2)  within 

the  algorithmic  framework  will  now  be  given. 

i 

STEP  1.  Define  k = (minimum  (i } | r a.-u.  > B } , if  such  a k does  not  exist 

j=l  J J 

the  optimal  solution  has  X;  = u.  for  all  j and  the  algorithm  terminates; 

J J 

otherwise  go  to  STEP  2. 


STEP  2.  Set  A * A* 
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I - k-1 

STEP  3.  Determine  xi5  j < k,  from  equations  (3.3)  and  define  S = T a^-. 

J j«l  J J 

STEP  4.  If  S > B (which  can  not  occur  the  first  time  through),  go  to  STEP  7; 

otherwise,  go  to  STEP  5. 

★ 

STEP  5.  If  S + a^x^  >_  B,  go  to  STEP  8;  otherwise,  k = k + 1 and  go  to  STEP  6. 

* * * 

STEP  6.  If  k > n,  set  Ak_j  = X^  and  xk  = 0,  go  to  STEP  7;  otherwise,  go  to 
STEP  2. 

★ 

STEP  7.  The  optimal  a for  the  relaxed  candidate  problem  is  between  Ak_j  and 
★ > 

Ak,  where  x ^ = maximum  fj(l).  The  optimal  x can  then  be  determined  by  a 

•k  * 

sequential  search  over  xk_j  _>  x _>  Ak-  The  optimal  solution  will  be  feasible 
for  the  quasi-integer  problem;  hence,  the  algorithm  terminates. 

STEP  8.  Create  two  branches  in  the  solution  tree  by  restricting  1 < < u^ 

down  one  branch  and  xk  = 0 down  the  opposing  branch. 

The  modifications  to  the  above  procedure  are  very  minor  when  a relaxed 

candidate  problem  with  the  last  restriction  fixing  xk  = 0 is  to  be  solved. 

Because  xk  is  being  removed  from  the  problem  and  was  not  zero  in  the  immediate 

★ 

successor,  the  optimal  a must  be  less  than  or  equal  to  Ak.  Thus,  the  searrh 

★ ★ 

can  begin  with  k = s(k)  (where  s(k)  is  the  successor  of  k before  branching) 
and  k is  updated  by  placing  k = s(k)  at  each  iteration.  In  STEP  3 equations 
(3.5)  are  used  in  place  of  (3.3)  to  determine  x.  Also,  the  algorithm  does  not 
terminate  when  a feasible  solution  to  the  quasi -i nteger  problem  is  found,  but 
backtracks  to  determine  either  optimality  or  the  next  candidate  problem  to 
consi der. 

The  modifications  to  the  solution  method  when  the  last  restriction 
places  1 i \ 1 uk  are  slightly  more  complicated  and  for  clarity  we  will  give 


STEP  6.  Create  two  branches  in  the  solution  tree  by  restricting  1 < < uk 

down  one  branch  and  xk  = 0 down  the  opposing  branch. 

★ 

STEP  7.  The  optimal  value  for  the  relaxed  candidate  problem  is  between  xk 

★ . ” 

and  x£,  where  i = s(k).  The  optimal  X can  then  be  determined  by  a sequential 
★ * 

search  over  xk  1 * i X . The  optimal  solution  will  be  feasible  for  the 
quasi -integer  problem;  hence,  the  algorithm  backtracks  to  determine  either 
optimal  it y or  the  next  candidate  problem  to  consider. 

A very  important  property  of  our  algorithm  is  that  a continuous  search 
over  x is  required  only  when  a feasible  solution  to  the  original  problem 
is  to  be  obtained.  A bisecting  search  (see  [14],  P.  122)  is  used  to  find 
the  optimal  x in  this  case.  A deviation  of  10-5  (a  tolerance)  from  the 
complementary  slackness  condition  is  the  criterion  for  terminating  the  search. 
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I 


t 


i 


[ 


Certain  bounds  can  easily  be  obtained  for  determining  the  suboptimality 

of  a candidate  problem  and  its'  descendants.  When  a dichotomy  is  performed, 

a lower  bound  on  the  optimal  solution  is  always  obtainable  by  rounding  to 

★ 

zero  the  xk  whose  value  is  in  the  interval  [0,  xk).  A lower  bound  is  also 

available  whenever  a continuous  search  takes  place.  At  any  time,  the  algorithm 

maintains  LB  equal  to  the  largest  of  these  lower  bounds  (the  incumbent  objective 

function  value).  An  upper  bound  on  any  feasible  completion  of  the  node  currently 

under  inspection  is  given  by  the  optimal  objective  value  of  the  relaxed 

candidate  problem.  Clearly,  whenever  this  upper  bound  is  not  greater  than 

LB,  the  node  is  fathomed  and  backtracking  takes  place. 

Pegging  (forced  moves  or  flagging)  is  also  possible  in  the  quasi-integer 

nonlinear  knapsack  algorithm.  Analogous  to  the  binary  knapsack  problem  where 

a variable  is  fixed  at  zero  or  one,  in  the  process  of  solving  the  problem 

considered  here  a variable  is  fixed  at  zero  or  forced  to  be  in  [1,  u j ] . To 

determine  criteria  as  to  when  pegging  can  be  performed,  we  state  and  prove 

at  a nonrigorous  level  the  following  theorems. 

Theorem  3.  Define,  z,  x and  A equal  to  the  optimal  objective  value,  x 

value,  and  A value,  of  the  relaxed  candidate  problem  currently  under  considera- 

★ — 

tion.  If  j e RL  and  A.  > A,  then  no  feasible  descendent  of  this  node  will 

J 

exist  with  xj  = 0 and  an  objective  value  greater  than 

UBj  * ‘2  - - V*j> 

Proof. 

If  xi  = 0,  which  amounts  to  dropping  xi  from  the  problem,  it  follows 

J J 

that  the  immediate  loss  in  the  objective  value  is  f.(x.«).  On  the  other  hand, 

J J 

an  upper  bound  on  the  ultimate  gain  is  obtained  by  investing  all  now  available 
resource  ajXj  at  the  best  possible  rate  of  return  A.  Hence,  an  upper  bound 


' 
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on  the  objective  value  of  any  feasible  descendant  of  this  node  with  xi  = 0 

J 

is 

1 - (fj(xj)  - 

q.e.d. 

Theorem  4.  Let  z.  A,  and  x be  defined  as  in  the  previous  theorem. 

* — 

If  j e RL  and  A.  < A,  no  feasible  descendant  of  this  node  will  exist  with 
J 

Xj  >_  1 and  an  objective  value  greater  than 

_ _ * 

UB . = z -(A  -a.-) a 
3 J j 


Proof. 


Because  j e RL  and  A^  < A,  x^  x 0. 


If  x.  >_  1 then  at  least  ai  must 
J J 


be  invested  in  project  j with  an  upper  bound  on  the  rate  of  return  given  by 
★ 

Aj.  On  the  other  hand,  it  will  be  necessary  to  cut  back  at  least  aj  from 
the  projects  currently  having  nonnegative  investments.  A lower  bound  on  the 
rate  of  loss  resulting  from  this  cut  back  is  A.  It  now  follows  that  any 
feasible  descendant  of  this  node  with  1 <_  <_  u.  will  have  an  objective  value 

less  than  or  equal  to 


UBj  • 2 -<*  -V*j 


Q.E.D. 

Whenever  UB  < LB,  the  index  j can  be  removed  from  RL  in  all  future 
descendants.  The  index  j is  placed  in  JU  if  UB.  is  determined  by  the  result 

J 

of  theorem  3 and  is  placed  in  JL  if  UB j is  determined  by  the  result  of  theorem  4. 

The  algorithm  described  herein  has  been  coded  in  FORTRAN  and  over  a hundred 
randomly  generated  quasi-integer  knapsack  problems  solved.  The  problems  reported 


in  table  1 have  u.  randomly  generated  from  a uniform  distribution  between 
3 

1.01  and  1.11,  the  objective  function  parameters  generated  so  that  approxi- 
* 

mately  90%  of  all  x^  e (1,  Uj),  and  the  aj  generated  from  uniform  distri- 
butions with  various  upper  and  lower  limits.  All  problems  were  solved 
on  The  University  of  Texas  CDC  6600  Computer  in  a timesharing  environment. 

Five  problems  were  solved  for  each  value  of  n.  The  times  and  number  of 

» 

branches  indicate  the  average  CPU  seconds  and  branches,  respectively,  to 
varify  optimality. 

Comparing  the  results  here  and  those  reported  by  Barr  and  Ross  [2], 
on  a CDC  CYBER  70/74-18,  would  indicate  that  a quasi-integer  nonlinear 
knapsack  requires  approximately  twenty  times  longer  to  solve  than  a binary 
knapsack  with  the  same  number  of  variables.  As  would  be  expected,  the 
quasi-integer  nonlinear  knapsack  algorithm  generates  fewer  branches  than  the 
corresponding  binary  knapsack  because  the  size  of  the  feasible  region  has 
increased.  On  the  other  hand,  the  time  required  to  solve  the  relaxed 
candidate  problems  is  greater. 

5.  Sample  Problem. 

A sample  of  400  projects  was  selected  from  records  of  the  Ontario 
Ministry  of  Transportation.  Associated  with  each  project  was  a capital 
outlay  x and,  utilizing  the  subsequent  performance  related  to  each,  f(x) 
was  computed.  This  data  was  split  into  20  categories  according  to  the 
average  daily  traffic  (ADT)  (<2000  ADT,  2000-4000  ADT,  4000-8000  ADT  and 
>8000  ADT)  and  region  of  the  province  (Northern,  Northwestern,  Eastern, 
Central  and  Southwestern).  The  number  of  data  points  varied  from  region  to 
region.  A regression  was  performed  on  the  data  in  each  of  the  categories, 
using  a quadratic  model  which  seemed  to  provide  a good  fit. 
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The  results  of  the  regression  are  shown  in  table  2.  These  values 
provide  the  objective  function  parameters  for  the  quasi -integer  knapsack 
problem.  In  the  particular  example  solved  as  an  illustration,  the  total 
budget  available  was  taken  as  B = $264,  590.  The  minimum  expenditures 
a-  are  also  given  in  table  2.  In  the  example  we  have  taken  each  of  the 

J 

twenty  functions  as  representing  a specific  project.  This  20  project 
problem  was  then  solved  using  the  algorithm  of  sections  3 and  4.  The 
results  are  shown  in  table  3. 

In  the  genera’,  case  with  many  projects  there  would  be  several  in  each 
category.  All  projects  in  the  same  category  would  be  represented  by  the 
same  quadratic,  on  a per  mile  basis.  However,  the  scaling  parameter,  the 
minimum  expenditure  and  the  value  f(x)  (which  is  a function  of  length  of 
the  road  section)  would  depend  on  the  particular  project  in  that  category. 

6.  Conclusions 

I 

While  we  have  directed  our  attention  toward  a capital  budeting  problem 
in  pavement  maintenance,  it  Is  apparent  that  other  problems  may  be  modeled 
in  a similar  fashion.  Two  assumptions  concerning  the  general  quasi-integer 
nonlinear  knapsack  problem  were  very  important  in  the  algorithmic  develop- 
ment. The  derivative  of  f.(x.-)  was  assumed  to  exist  everywhere  in  [1,  u-] 
and  inverse  function  of  this  derivative  was  assumed  to  be  obtainable  in 
closed  form.  An  absence  of  these  two  properties  would  greatly  increase 
solution  times  as  a search  procedure  would  be  required  when  solving  each 
relaxation. 

The  computational  results  reported  in  this  paper  indicate  that  realistic 


sized  capital  budgeting  problems  can  be  solved  as  quasi-integer  nonlinear 
knapsack  problems.  We  have  formulated  a convexification  of  the  original 


problem  and  solved  this  relaxation  at  every  stage  of  the  algorithm.  The 
strength  of  the  method  lies  in  the  ability  to  solve  the  relaxations  in  an 
efficient  manner.  Hopefully,  the  techniques  presented  here  can  be  utilized 
on  other  wel 1 -structured  discontinuous  nonlinear  programming  problems. 


1 
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n 50 

100 

150 

200 

250 

300 

350 

400 

450 

500 

Time  (seconds)  .20 

.46 

.62 

.56 

.86 

1.29 

1.20 

1.22 

3.00 

2.34 

Branches  63 

60 

59 

34 

42 

58 

35 

41 

99 

55 

Table  1.  Five  randomly  generated  quasi-integer  nonlinear  knapsack  problems  were  solved 
for  each  value  of  n.  The  average  time  and  average  number  of  branches  for  each  of  the 
problem  sets  are  indicated. 


thousands  of  dollars).  The  upper  bound  on  the  variables  is  1.1. 
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[13  abstract 


This  paper  models  a capital  budgeting  problem  in  pavement 
maintenance  as  a nonlinear  quasi-integer  knapsack  program  and  presents 
a solution  procedure.  It  must  be  determined  if  certain  segments  of  road 
will  be  repaved  or  major  maintenance  postponed  for  at  least  another  year. 
If  the  road  is  to  be  repaved,  a certain  amount  of  variation  in  the  funds 
expended  is  possible.  The  marginal  return  within  the  allowable  interval 
of  variation  is  estimated  to  be  nonlinear.  Also,  a single  linear  constraint 
limiting  the  total  amount  of  funds  expended  is  present.  Computational 
experience  with  the  algorithm  and  a brief  overview  of  other  applications 
of  the  model  are  given. 
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